Qualitatively Describing Objects Using Spatial Prepositions
نویسندگان
چکیده
The objective in this paper is to present a framework for a system that describes objects in a qualitative fashion. A subset of spatial prepositions is chosen and an appropriate quantiication is applied to each of them that capture their inherent qualitative properties. The quantiications use such object attributes as area, centers, and elonga-tion properties. The familiar zeroth, rst, and second order moments are used to characterize these attributes. This paper will detail how and why the particular quantiications were chosen. Since spatial prepositions are by their nature rather vague and dependent on context a technique for fuzzi-fying the deenition of the spatial preposition is explained. Finally an example task is chosen to illustrate the appropriateness of the quantiication techniques.
منابع مشابه
Describing Spatial Relationships between Objects in Images in English and French
The context for the work we report here is the automatic description of spatial relationships between pairs of objects in images. We investigate the task of selecting prepositions for such spatial relationships. We describe the two datasets of object pairs and prepositions we have created for English and French, and report results for predicting prepositions for object pairs in both of these la...
متن کاملAutomatic Classification of Containment and Support Spatial Relations in English and Dutch
The need to communicate and reason about space is pervasive in human cognition. Consequently, most languages develop specialized terms for describing relationships between objects in space – spatial prepositions. However, the specific set of prepositions and the delineations between them vary widely. For example, in English containment relationships are categorized as in and support relationshi...
متن کاملNeural systems underlying spatial language in American Sign Language.
A [(15)O]water PET experiment was conducted to investigate the neural regions engaged in processing constructions unique to signed languages: classifier predicates in which the position of the hands in signing space schematically represents spatial relations among objects. Ten deaf native signers viewed line drawings depicting a spatial relation between two objects (e.g., a cup on a table) and ...
متن کاملGenerating Descriptions of Spatial Relations between Objects in Images
We investigate the task of predicting prepositions that can be used to describe the spatial relationships between pairs of objects depicted in images. We explore the extent to which such spatial prepositions can be predicted from (a) language information, (b) visual information, and (c) combinations of the two. In this paper we describe the dataset of object pairs and prepositions we have creat...
متن کاملThe Use of Object Labels and Spatial Prepositions as Keywords in a Web-Retrieval-Based Image Caption Generation System
In this paper, a retrieval-based caption generation system that searches the web for suitable image descriptions is studied. Google’s search-by-image is used to find potentially relevant web multimedia content for query images. Sentences are extracted from web pages and the likelihood of the descriptions is computed to select one sentence from the retrieved text documents. The search mechanism ...
متن کامل